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correlational effect sizes was found to lead to inaccurate results, 
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"d” -based and "r" -based effect size indices is presented. Results of applying 
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Two general categories comprise the various efifect size indices that have been proposed 
for use in meta-analysis: (a) the <i-type estimator (based on magnitude of mean difference), and (b) 
the r-type estimator (based on magnitude of correlation). In meta-analyses, researchers often must 
convert these efifect size indices-to a conunon metric to empirically aggregate and synthesize results 
from various studies. A commonly recommended formula for equating mean-difference efifect sizes 
and correlational efifect sizes was found to lead to inaccurate results, particularly with small sample 
sizes. A correct formula for converting (3^-based and r-based efifect size indices is presented. 
Results of applying the common and corrected formulas are illustrated for a variety of data 
conditions at various sample sizes and efifect sizes, suggesting that bias as large as 20% results 
from the common formula, all of which can be avoided by applying the alternative equation. 
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Purpose 

The purpose of this paper is to inform researchers about inaccuracies that can result from 
applying a commonly cited formula for converting effect size indices based on mean differences to 
effect size indices based on correlation. A corrected formula for equating these t/-based and r- 
based effect size indices is presented. In addition, a demonstration of the potential bias of the 
commonly recommended formula is provided under data conditions displaying a variety of effect 
sizes, sample sizes, and degrees of inequality between sample sizes. 

Background 

Essential to synthesis of research are the processes of comparing and combining the results 
of studies pertaining to a particular research question. Meta-analysis is a prominent method of 
synthesis that uses statistical procedures to summarize findings from various individual studies, 
seeking an objective integration of the results of research conducted in an area of particular 
interest. In recent years, meta-analytic methods for summarizing research results across studies 
have proliferated in the social, behavioral, and biomedical sciences (Wolf, 1986). 

Generally, meta-analysis summarizes independent statistical tests of a common hypothesis, 
and the strength of the relationship of interest. The latter is summarized by calculating effect sizes. 
Various effect size measures have been proposed for different test statistics (Rosenthal, 1994). 

Two general categories of effect size are conceptualized as (a) the z/-type estimator (based on 
magnitude of mean difference), and (b) the r-type estimator (based on magnitude of correlation). 
The z/-type effect size estimators derive a standardized mean difference that Cohen (1988) 
describes as a “pure number, one free of our original measuremenLunit with which to index what 
can be alternatively called the degree of departure from the null hypothesis of the alternative 
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hypotheses . . . This difference between two sample means, expressed in standard deviation 
umts, is frequently referred to as Cohen’s d , and is represented as: 



d 



Xx-Xi 

Spooled 



( 1 ) 



In correlational studies, an effect size can be described as a signal-to-noise ratio, and 
estimates the strength of relationship between interval or ratio scale measures. Such an effect size 
estimate is offered by Cohen (1983, p. 1 17) as: 

2 






l-r^ 



( 2 ) 



In meta-analytic reviews of literature, the set of studies defined for review by the 
researcher often comprises diverse analysis procedures, requiring use of both d- and r-type 
estimators. In order to aggregate and synthesize these results, one must translate the various effect 
size estunates into a common metric. The statistic usually chosen as the basis for this common 
metric is r (the Pearson Product-Moment coefficient) (Wolf, 1986). Procedures for converting d to 
r have been discussed by Cohen (1965, 1988), Friedman (1968), Glass, McGraw, and Smith 
(1981), Rosenthal (1984), and Wolf (1986), with the following formula provided for expressing 
as r. 




Equivalently, a conversion from r to is offered as: 

2r 

' VTV ^4) 
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These formulas, however, negatively bias estimates of r relative to d, particularly when 
sample sizes are unequal. This was accounted for by Hedges and Olkin (1985, p. 77), who offered 
the conversion from dXior appropriately as an approximation: 



r2=. 



t/2 



+ «2 - "iy n 



( 5 ) 



where « = («l«2)/(«l +«2). 



When n, = ri 2 = n formula 5 reduces to; 



r 
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d^ 

d^+4(n-l)/n 



d^ 

d^+4 



( 6 ) 



This indicates correctly both the approximation provided by formula 3, and the conditional 
appropriateness of formula 3 for conversion when sample sizes are equal. 

One way of illustrating the relationship of d- and r- based estimators is by considering the 
test of significance for differences between two sample group means, where the Mest of the 
standardized mean differences between groups, and the t-test associated with the point biserial 
correlation between group and dependent variable, are identical. An exact equation for the 
conversion of d tor can be derived from the relationship of the test of significance and effect size 
for a given study, noted by Rosenthal (1994) as 

Test Statistic = Effect Size x Size of Study, 

or, for the specific case in which effect size is expressed as the standardized mean difference 
between two groups. 
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It follows that 



t =■ 



d = r 
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d^ = 
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(7c) 

(7d) 

(7e) 

(7f) 

(7g) 

(7h) 

( 8 ) 



Equation 8 can be seen as an alternative derivation of a conversion formula offered by 
Cohen (1988, p. 24) for the general case (i.e., applicable to unequal sample sizes), with p as the 
proportion in one group on a dichotomous variable, and q = l-p: 

d?- (9) 



/•2 = 
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Therefore, corrected equation 8 can be seen to differ from equation 9a by replacement of 
with tP -2N in the second term of the denominator. 

For balanced situations, in which corrected equation 7h reduces as follows; 



i/2 + (TV- 2) 1 




(10) 


c/2 










(10a) 


r = 1 
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Thus, for balanced situations, corrected equation 10b is seen to differ from commonly 
recommended formula 3 by subtraction of the last term in the denominator. 

Data Source and Method 

To provide a demonstration of the bias associated with formulas 3 and 9, the equations 
were applied to data conditions for pairs of samples having varying effect si 2 es, sample sizes, and 
degrees of inequality between sample sizes. These conditions represented sample pairs vvith 
standardized mean differences (d - type effect sizes) of 0.2, 0.5, and 0.8. These levels represent 
treatment effects ranging from small to large, as suggested by Cohen (1988). Sample sizes for 
cases in which nj = n 2 = n were 5, 10, 20, 30, 40, 50, and 100. For the unbalanced sample size 
comparisons, rii + ri 2 = 20, and the magnitude of inequality between sample sizes ranged from zero 
(where rii = ri 2 = 1 0), to a ratio of 9: 1 (where = 1 8 and ~2). These conditions were deemed to 
provide a practical range for investigating the differences resulting from application of the 
commonly recommended formulas for equating c/-type and 7 *-t 5 q)e effect size estimators and 
application of the alternative Corrected formulas. 
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Values of r derived by the commonly recommended formulas (formulas 3 and 9) and the 
values of r provided by the corrected formulas (formulas 8 and 10b) were calculated for each 
umque set of conditions. These values of r were then used to calculate . Bias is shown as the 
difference between the tabled values of r and p derived by the common and actual formulas. The 
proportion of the actual effect size estimate comprising this bias is shown as proportional bias. 

Results and Conclusions 

Results presented in tables 1 and 2 demonstrate the magnitude of discrepancy found when 
applying the commonly recommended formula, and the alternative equations shown as formulas 8 
and 10, for balanced and unbalanced sample sizes. Differences between the tabled values of r and 
derived by the commonly recommended formulas, and the values of these effect size estimates as 
provided by the corrected formulas, are shown as bias, with proportional bias indicating the size of 
this bias as a proportion of the actual effect size estimate (calculated with the corrected formula). 

As shown in tables 1 and 2, bias associated with the common formula is particularly 
problematic for small sample sizes and when converting a </-based effect size estimate to an f^- 
based effect size estimate. Among the conditions examined, the largest bias (20%) was found 
when translating d to for ni — n^ — 5. Even for Nj — n^— 100, a bias of 1% was avoided with the 
corrected formula. With unbalanced samples, conversion of dtof^ incurred a bias of 10%, and 
estunation of r from d biased effect size estimates by 4% to 5%. For unbalanced samples, the 
extent of inequality in sample sizes had no practical effect on proportional bias. When estimating 
from d for these conditions, this bias was constant at 10%. The size of treatment effect 
demonstrated no practical mfluence on the extent of bias found for estimates of either or r, given 

any particular combuiation of n, andn^. Given these results, use of the corrected formulas by 
analysts seeking to synthesize c/-type and r-type estimates in meta-analysis is recommended. 
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The inaccuracy resulting from application of the more commonly cited, approximate 
equation will differ according to the range of n, and might be negUgible for certain conditions. For 
example, less bias was found for larger samples and when estimating r from d. Discrepancies 
tended to be negligible, therefore, when estimating r from d with balanced sample sizes of 50 or 
more. 

Implications 

In meta-analyses, researchers often encounter studies utilizing diverse research designs in 
which some effect sizes might be based on standardized differences in means, while others might be 
based on the correlation between variables. In order to empirically aggregate and synthesize the 
results from such diverse analyses, the meta-analyst must convert these effect sizes to a common 
metric. The commonly recommended formulas for equating correlational effect sizes and mean- 
difference effect sizes were found to lead to inaccurate results, particularly for small samples and 
when translating d iop. Corrected formulas for converting c/-based and r-based effect size indices 
were presented and demonstrated. Since the corrected formulas are straightforward, and the 
accuracy of meta-analysis can be improved by their use, this is an important detail for researchers 
concerned with meta-analytic methods. 
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Table 1. Estimations of r and with equal sample sizes 



Estimating r from ^ 


N1 


N2 


d 


Common Formula 


Actual (Corrected Formula) 


Bias * 


ProDortional Bias ** 


5 


5 


0.2 


.0995 


.1111 


-.0116 


-.1045 


10 


10 


0.2 


.0995 


.1048 


- .0053 


- .0508 


20 


20 


0.2 


.0995 


.1021 


- .0026 


-.0251 


30 


30 


0.2 


.0995 


.1012 


- .0017 


-.0166 


40 


40 


0.2 


.0995 


.1008 


-.0013 


- .0125 


50 


50 


0.2 


.0995 _ 


.1005 


-.0010 


-.0100 


100 


100 


0.2 


.0995 


.1000 


- .0005 


- .0050 
















5 


5 


0.5 


.2425 


.2692 


- .0267 


- .0990 


10 


10 


0.5 


.2425 


.2548 


-.0123 


- .0482 


20 


20 


0.5 


.2425 


.2485 


- .0059 


- .0238 


30 


30 


0.5 


.2425 


.2464 


- .0039 


-.0158 


40 


40 


0.5 


.2425 


.2454 


- .0029 


-.0118 


50 


50 


0.5 


.2425 


.2449 


- .0023 


- .0095 


100 


100 


0.5 


.2425 


.2437 


-.0011 


- .0047 
















5 


5 


0.8 


.3714 


.4083 


- .0368 


- .0903 


10 


10 


0.8 


.3714 


.3885 


- .0171 


- .0441 


20 


20 


0.8 


.3714 


.3797 


- .0083 


- .0218 


30 


30 


0.8 


.3714 


.3768 


- .0055 


- .0145 


40 


40 


0.8 


.3714 


.3755 


- .0041 


-.0108 


50 


50 


0.8 


.3714 


.3746 


- .0032 


- .0087 


100 


100 


0.8 


.3714 


.3730 


- .0016 


- .0043 




















Estimating from ^ 


5 


5 


0.2 


.0100 


.0125 


- .0025 


- .2000 


10 


10 


0.2 


.0100 


.0111 


-.0011 


-.1000 


20 


20 


0.2 


.0100 


.0105 


- .0005 


- .0500 


30 


30 


0.2 


.0100 


.0103 


- .0003 


-.0333 


40 


40 


0.2 


.0100 


.0103 


- .0003 


- .0250 


50 


50 


0.2 


.0100 


.0102 


- .0002 


- .0200 


100 


100 


0.2 


.0100 


.0101 


-.0001 


- .0100 
















5 


5 


0.5 


.0625 


.0781 


1 

o 

o^ 


- .2000 


10 


10 


0.5 


.0625 


.0694 


- .0069 


-.1000 


20 


20 


0.5 


.0625 


.0658 


- .0033 


- .0500 


30 


30 


0.5 


.0625 


.0647 


- .0022 


- .0333 


40 


40 


0.5 


.0625 


.0641 


-.0016 


- .0250 


50 


50 


0.5 


.0625 


.0638 


- .0013 


- .0200 


100 


100 


0.5 


.0625 


.0631 


- .0006 


-.0100 
















5 


5 


0.8 


.1600 


.2000 


- .0400 


- .2000 


10 


10 


0.8 


.1600 


.1778 


- .0178 


-.1000 


20 


20 


0.8 


.1600 


.1684 


- .0084 


- .0500 


30 


30 


0.8 


.1600 


.1655 


- .0055 


- .0333 


40 


40 


0.8 


.1600 


.1641 


- .0041 


- .0250 


50 


50 


0.8 


.1600 


.1633 


- .0033 


- .0200 


_LQQ_ 


IQQ 


JL&. 


1600 





- -0016 


- -0100 



Note: All estimates rounded to four digits 
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* Bias = (Common - Actual) 

** Proportional Bias = (Bias h- Actual) 



Table 2. Estimations of r and with unbalanced sample sizes 



Estimating r from 


N1 


N2 




Common Formula 


Actual (Corrected Formula) 


Bias * 


ProDortional Bias ** 


-LQ 


10 


_(L2_ 


D225 


.1048 


- 0053 


- 0508 


11 


9 


-1L2_ 


D22Q 


JQ43 


- 0053 


- 0508 


12 


8 


JL2- 


1)225 


.1027 


- .0052 


- .0508 


_LL_ 


7 


_(L2_ 


D250 


-1001 


- 0051 


- 0508 


14 


6 


_(L2_ 


D213 


D262 


- 0049 


- 0509 


15 


5 


-OX 


D863 


.0909 


- 0047 


- 0509 


16 


4 


_(L2_ 


.0798 - 


.0840 


- 0043 


- 0510 


17 


3 


JL2_ 


.0712 


.0751 


- .0038 


- 0510 


18 


2 


0.2 


.0599 


.0631 


- .0032 


- .0511 


10 


10 


JL5 


■2425 


■2548 


- 0123 


- 0482 


dL 


9 


_QJ_ 


2114 


■2536 


-.0122 


- 0483 


-12 


8 


-QJJ 


■2379 


■2500 


- 0121 


- 0483 


13 


7 


JUJ 


.2320 


■2438 


- 0118 


- 0485 


14 


6 


-QJJ 


.2233 


■2348 


- 0114 


- 0487 




5 


_QJ_ 


.2116 


■2225 


- 0109 


- 0490 


16 


4 


_QJ_ 


.1961 


■2063 


- 0102 


- 0493 


17 


3 


_QJ_ 


.1758 


■ 1850 


- 0092 


- 0497 


18 


2 


0.5 


.1483 


.1562 


_ - .0078 


- .0502 


10 


10 


JL8- 


.3714 


■3885 


- 0171 


- 0441 


11 


9 


JLS- 


.3698 


■3869 


- .0171 


- 0441 


12 


8 


_QJ_ 


.3649 


■3818 


- 0169 


- 0443 


13 


7 


-1LS- 


.3565 


■3732 


- 0167 


- 0446 


14 


6 


-0*8- 


.3442 


■3605 


- 0163 


- 0451 


15 


_5 


_(LS_ 


.3273 


■3430 


- 0157 


- 0457 


16 


4 


_(LS_ 


.3048 


■3196 


-.0148 


- 0464 


17 


3 


_(LS_ 


.2747 


■2883 


- 0137 


- 0473 


Jll^ 


-_2_ 


JLS. 


2224 


2453 


-0119 


- -0485 






Estimating from d 


"lO 


10 


_(L2_ 


.0100 


0111 


- 0011 


- 1000 


11 


9 


_(L2_ 


.0099 


0110 


- 0011 


- 1000 


12 


8 


_(L2_ 


0096 


■0107 


- 0011 


- 1000 


13 


7 


_(L2_ 


.0091 


■0101 


- 0010 


- 1000 


14 


6 


JL2_ 


.0084 1 


.0093 


- 0009 


- 1000 


15 


5 


_(L2_ 


.0075 


■0083 


- 0008 


- 1000 


16 


4 


_QX 


.0064 


■0071 


- 0007 


- 1000 


17 


_3 


02- 


.0051 


■0057 


- 0006 


- 1000 


18 


2 


0.2 


.0036 


.0040 


- .0004 


- .1000 


10 


10 


_QJ_ 


0625 


■0694 


- 0069 


- ibbb 


11 


9 


_QJ_ 


.0619 


■0688 


- 0069 


- 1000 


-12 


8 


JL5- 


.0600 


■0667 


- 0067 


- 1000 


13 


7 


_QJ_ 


.0569 


■0632 


- 0063 


- 1000 


14 


6 


_QJ_ 


.0525 


■0583 


- 0058 


- 1000 


15 


5 


_QJ_ 


.0469 


■0521 


- 0052 


- 1000 


16 


4 


JL5- 


_ .0400 


■0444 


- 0044 


- 1000 


17 


3 


JL5- 


.0319 


■0354 


- 0035 


- 1000 


18 


2 


0.5 


.0225 


.0250 


... - .0025 


-■1000 


"io" 


10 




.1600 


■ 1778 


- 0178 


- ibbb 


11 


9 


_(LS_ 


.1584 


1760 


- 0176 


- 1000 


12 


8 


_(LS_ 


.1536 


■ 1707 


- 0171 


- .1000 


13 


7 


_(L8_ 


.1456 


■ 1618 


- 0162 


- 1000 


14 


6 


JLS_ 


.1344 


■ 1493 


- 0149 


- .1000 


15 


5 


JLS- 


.1200 


■ 1333 


- 0133 


- 1000 


16 


4 


JLS- 


.1024 


■ 1138 


- 0114 


- 1000 


17 


3 


JL8- 


.0816 


■0907 


- 0091 


- 1000 


-18 


2 


JiX 


0576 


om 


- 0064 


-.1000 




Note: All estimates rounded to four digits 

* Bias = (Common - Actual) 

** Proportional Bias = (Bias Actual) 
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